NUMBERS  GENERAL  LATTICE  DISTRIBUTIONS^)  STANFORD  UNIV 
CA  DEPT  OF  STATISTICS  J  A  FILL  ET  AL  OCT  87  TR-1 
UNCLASSIFIED  N00014-87-K-0078  F/G  12/1  NL 


MICROCOPY  RESOLUTION  TEST  CHART 

NATIONAL  BUREAU  Of  STANDARDS- 1963-A 


AD-A187  560 


’  OTIC  FILE  COP* 


THE  CONVERGENCE  RATE  FOR  THE  STRONG  LAW  OF 
LARGE  NUMBERS:  GENERAL  LATTICE  DISTRIBUTIONS 


by 

James  Allen  Fill  and  Michael  J.  Wichura 
Stanford  University  and  The  University  of  Chicago 


TECHNICAL  REPORT  NO.  3 
OCTOBER  1987 


DTIC 


NOV  1  0 1987 


PREPARED  UNDER  CONTRACT 
N00014-87-K-0078  (NR-042-373) 

FOR  THE  OFFICE  OF  NAVAL  RESEARCH 


Reproduction  in  Whole  or  in  Part  is  Permitted 
for  any  Purpose  of  the  United  States  Government 

Approved  for  public  release;  distribution  unlimited 


DEPARTMENT  OF  STATISTICS 
STANFORD  UNIVERSITY 
STANFORD,  CALIFORNIA 


THE  CONVERGENCE  RATE  FOR  THE  STRONG  LAW  OF 
LARGE  NUMBERS:  GENERAL  LATTICE  DISTRIBUTIONS 

by 

James  Allen  Fill  and  Michael  J.  Wichura 
Stanford  University  and  The  University  of  Chicago 


TECHNICAL  REPORT  NO.  3 
OCTOBER  1987 

PREPARED  UNDER  CONTRACT 
N00014-87-K-0078  (NR-042-373) 

FOR  THE  OFFICE  OF  NAVAL  RESEARCH 


Reproduction  in  Whole  or  in  Part  is  Permitted 
for  any  Purpose  of  the  United  States  Government 


Approved  for  public  release;  distribution  unlimited 


DEPARTMENT  OF  STATISTICS 
STANFORD  UNIVERSITY 
STANFORD,  CALIFORNIA 


I  Arco.i 

f~ . - 

I  .V  IS 


J.  f 


t  J\- 

t-  - 

!  My 
! 

j — 


f hi 


*  • 


1.  Introduction  and  formulation  of  results. 

Let  A'j,  A'?, ...  be  a  sequence  of  independent  random  variables  with  common  distribution 
function  F.  Denote  the  random  walk  of  partial  sums  by  S„  =  A with  So  s  0.  To  facili¬ 
tate  notation  we  introduce  another  random  variable  A  distributed  according  to  F.  Throughout 
this  paper  we  adopt 

Assumption  0:  EX  =  0,  Var  A  =  1 
and  write 

A-(0  =  log£(e<'V) 

for  the  cumulant  generating  function  (cgf)  of  A,  I  for  the  set  of  £  for  which  K(£)  <  00,  and 
7°  for  its  interior.  Let  c  (>  0  throughout)  and  a  be  given  real  numbers,  and  denote  by  g  the 
straight  line 

g(t)  =  a  +  cf. 

The  notation  E(Y;A)  used  herein  is  shorthand  for  E(YIA). 

The  problem  addressed  in  this  paper  is  to  determine  the  asymptotic  rate  at  which  the 
boundary  crossing  probabilities 

(1.1)  £{Sm>S(m)} 
and 

(1.2)  pm  =  P{Sn  >  g(n)  for  some  n  >  m) 

converge  to  zero  as  m  —  oc.  These  probabilities  are  of  interest  largely  because  when  a  =  0 
the  weak  and  strong  laws  of  large  numbers  (WLLN  and  SLLN)  amount,  respectively,  to  the 
assertions  that  (1.1)  and  (1.2)  tend  to  zero.  Fill  (1980,  1983)  has  also  used  approximating 
linear  boundaries  with  nonzero  intercept  to  obtain  an  asymptotic  expression  for  (1.2)  when  g 
is  a  curved  boundary. 

Fill  (1980.  theorem  3.4.1).  slightly  generalizing  computations  of  Bahadur  and  Ranga  Rao 
( 1960)  and  Siegmund  (1975).  determined  the  convergence  rates  for  (1.1)  and  (1.2)for  non-lattice 
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distributions  F  and  for  a  wide  but  not  exhaustive  class  of  lattice  distributions  F.  The  objective 
of  this  note  is  to  establish  the  convergence  rates  for  the  remaining  lattice  distributions  F. 

In  stating  our  results  we  shall  refer  to  the  following  list  of  possible  assumptions  about  F 
and  g : 

Assumption  1:  There  exists  |o  #  0  in  7°  for  which  A''(£0)  =  <• 

Assumption  1':  There  exists  0  in  1°  for  which  K(£i)  =  eft. 

Assumption  2a:  F  is  non-lattice. 

Assumption  2b:  F  is  concentrated  on  a  lattice  {b  +  jh  :  j  €  Z  }  having  span  h  >  0 
and  (for  definiteness)  b  €  [0,h). 

Assumption  2b':  Assumption  2b  is  met,  c  is  in  the  lattice  for  F ,  and  a  is  an  integer 
multiple  of  h. 

From  standard  facts  about  the  cgf 

A’t(0  =  A'(0  - 

for  £(.Y  -  c)  it  follows  that  1'  implies  1.  that  if  1  holds  then  (o  is  unique  and  positive,  and  that 
if  1'  holds  then  >  £0  >  0  is  also  unique.  One  can  show  easily  that  if  0  £  1°  then  1'  holds 
for  all  small  t  >  0.  Assumptions  2a  and  2b  are  mutually  exclusive  and  exhaustive  possibilities, 
and  2b'  is  a  special  case  of  2b. 

Fill  (1980.  theorem  3.4.1;  essentially  repeated  as  Theorem  0  below)  determined  the  con¬ 
vergence  rate  for  (1.1)  (respectively,  (1.2))  when  assumptions  0,  1  (respectively,  1'),  and  either 
2a  or  2b'  are  met.  In  Theorem  1  below  we  extend  Fill’s  result  under  assumption  2b'  to  the 
more  general  case  2b.  When  q  =  0  our  result  recaptures  the  principal  result  of  Bahadur  and 
Ranga  Rao  (1960)  for  (1.1)  in  their  “case  2”  (see  also  Blackwell  and  Hodges  (1959))  and  extends 
theorem  1  in  Siegmund  (1975)  dealing  with  (1.2).  When  comparing  (1.9)  and  (1.20)  below  to 
the  results  of  Bahadur  and  Ranga  Rao,  note  the  strict  inequality  in  our  formulation  (1.1)  and 
the  weak  inequality  in  theirs:  the  difference  is  addressed  in  section  4.2  of  Fill  (1980)  and  in 


Section  2.1  below.  When  comparing  (1.9)  and  (1.21)  below  to  Siegmund’s  theorem,  it  is  im¬ 
portant  to  note  that  (i)  the  factor  (exp(flih)  -  1)  appearing  on  the  right  in  his  (14)  should  be 
(1  -  exp(-^ih)),  and  (ii)  in  his  (11)  Siegmund  tacitly  assumes  (see  the  proof  of  his  lemma  1) 
that  h  is  the  span  of  F.  Consequently  when  a  =  0  our  assumption  2b'  amounts  to  Siegmund’s 
(11).  For  given  F  satisfying  assumption  2b,  assumption  2b'  precludes  all  values  of  e  smaller 
than  6;  this  is  a  severe  restriction  indeed  since  the  most  interesting  values  of  c  (in  relation  to 
the  laws  of  large  numbers)  are  values  near  zero. 

Even  when  a  =  0  our  new  result  for  (1.2)  handles  some  important  lattice  distributions  F 
for  which  Siegmund's  result  says  nothing.  For  example  in  the  case  (A'  =  ±1  with  probability 
1/2  each)  of  simple  symmetric  random  walk,  A'(£)  =  log  cosh  £  for  £  €  IR  and  each  of  the 
assumptions  1  and  1'  is  equivalent  to  e  <  1.  Then  assumption  2b'  does  not  hold,  but  of  course 
the  more  general  2b  does,  with  h  =  2. 

In  a  forthcoming  paper  (Fill.  19S7)  one  of  the  present  authors  will  present  a  new  argument 
due  in  part  to  David  Siegmund  yielding  the  convergence  rate  -  and  under  further  conditions 
an  asymptotic  expansion  -  for  (1.2)  in  cases  2a  and  2b  when  assumption  1'  is  weakened  to 
assumption  1. 

To  state  our  results  we  need  some  additional  notation.  Suppose  assumptions  0  and  1  are 
met.  Let  Pq  denote  the  probability  measure  under  which  A',  Ai,  A’j, . . .  are  i.i.d.  with 

(1.3)  Pq{X  €  dx }  =  exp[£0*  -  A\(£o )]P{X  -  (  €  dx}. 

P0  has  cgf 

(1.4)  4>(6)  =  A\(*o  +  *)  -  Ii'M  =  A'(fc>  +  9)  -  A(&>)  -  <9, 
mean 

(1.5)  d>'(0)  =  A''(£0)  =  0, 
and  variance 

( l.G)  <r2  :=  d"(0)  =  A'"(£0)  =  AT"«b). 
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Put 


0o  =  -fo  <  0; 


^o)  =  -/vtUo)  =  ^2-f3A(€)>0, 


where  A  is  the  Cramer  series  for  F. 

Theorem  0.  (Fill,  19S0)  If  assumptions  0, 1,  and  either  2a  or  2b'  are  met ,  then  asm  —> 


P{Sm  >  g(m)}  ~  a„ 


If  assumption  1'  a/so  holds,  then  as  m  — ►  oc 


(1.10) 


(1-11) 


Pm  ~  (1  +  7)flm- 


am  :=  C(27r<r2m)-1/,2exp(-m^(tfo)  -  |0o|Q) 


(1.12)  0  <  7 


:«e*p{fy* 

U=i 


(c-n^(e,)Fo{Sn  >  0}  _  P{Sn  >  cn}] 


}-• 


where  if  assumption  2a  is  met 


(1.13a) 


while  if  assumption  2b'  is  met 


(1.13b) 


C  =  l^ol"1 


C  =  h[exp(|0o|>O  -  1]’ 


When  assumption  2b  holds  we  define  for  every  m 


(1.14) 


=  fractional  part  of  h~l(g{m)  -  bm). 


r  r  T  ^  *- 


(1.15) 


em  =  exp(|0o|Mm)  -  1, 


oo  oo  oo  j  oo 

(1.16)  \m  =  (1  +  7)_1exp  -  ^n_1P{5„  >  en}  ^  em+ntin  =  y  em+nti„  /  ^  un, 

.  n=l  n=0  n=0  ’  n— 0 

where  7  is  given  by  (1.12)  and  (t/„)  has  generating  function 


(1.17) 


i(z)  =  unzn  =  exp 


n=0 


y  zkk~l  exp(-k<t>(ff0))Po{Sk  >  0} 


Lfc=i 


valid  for  all  complex  2  with  \z\  <  1. 

Notice  that  when  assumption  2b'  holds,  6m,  em,  and  Am  all  vanish  identically.  In  general, 
0  <  Sm  <  1, 

(1.18)  0  <  em  <  exp(|0o|/O  -  1, 


and 


(1.19) 


0  <  Am  <  exp(l^ol^)  -  I- 


We  now  state  the  principal  result  of  this  note. 

Theorem  1.  If  assumptions  0,  1,  and  2b  are  met,  then  asm-*  00 

(1.20)  P{Sm  >  g(tn)}  ~  am(l  +  em). 

If  assumption  1'  also  holds ,  then  as  m  — * >  00 

(1.21)  pm  ~(l+7)<*m(l  +  Am). 

Here  we  have  used  the  notation  of  (1.11),  (1-12),  (1.13b),  (1.15),  and  (1.16). 

Remark.  How  big  are  the  quantities  involved  in  Theorems  0  and  1  when  c  is  small? 
(a)  One  can  show  easily  for  any  F  satisfying  assumption  0  and  0  €  7°  that  as  e  j  0 

(1.22)  |0O|  -  <,  C~  f-\  <t2  -  1,  ^(0O)~^<2, 
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where  C  is  given  by  (1.13a)  or  (1.13b)  according  as  assumption  2a  or  2b  is  met.  As  Siegmund 
(1975,  remark  4(b))  notes, 


1  * 1 


* 


'  ,f 


#.-/! 
*'/ , 


i  i 


•• 


(1.23)  7  — ►  1  as  e  |  0. 

We  identify  7  up  through  order  c  in  Section  5.1  below. 

(b)  In  light  of  (1.18)— (1.19)  we  find 

(1.24)  0  <  em  =  Oft)  —  o(l)  uniformly  in  m  as  e  1  0 
and  likewise 

(1.25)  0  <  Am  =  Oft)  =  o(l)  uniformly  in  m  as  t  J  0 

when  F  satisfies  assumption  0  and  0  €  7°.  We  characterize  the  order-c  behavior  of  the  sequences 
(em)  and  (Am)  in  Section  5.2  below.  In  particular  we  obtain  the  result 

(1.26)  —■  —  i  uniformly  in  m  as  c  j  0, 

showing  that  even  on  the  scale  of  c  the  factor  1  +  Am  added  in  going  from  (1.10)  to  (1.21)  varies 
little  as  m  changes  when  c  is  small.  | 

The  proof  of  Theorem  1  is  given  in  Section  2.  Sections  3  and  4  discuss  further  the  situation 
in  which  h~l(t  -  b)  is  irrational  and  rational,  respectively.  In  particular,  when  h~lft  —  b)  is 
rational  we  simplify  the  formulation  (1.16)— (1.17)  of  Am:  see  (4.10)-(4.11).  In  Section  5  we 
analyze  7,  (em),  and  (Am)  for  small  t. 


i%;t vr 
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2.  Proof  of  Theorem  1. 


2.0.  Preliminaries.  To  prepare  for  the  proof  of  Theorem  1  we  introduce  the  distributions 
associated  through  “exponential  tilting”  with  that  of  X  under  Pq.  This  is  accomplished  by  (8) 
in  Siegmund  (1975),  but  we  de.  cribe  the  setup  here  for  completeness.  For  each  real  0  for  which 
$(9)  <  oc,  let  P$  denote  the  probability  under  which  A',  A'i,  Xj, . . .  are  i.i.d.  with 

Pe{ X  e  dx)  =  exp [6x  -  <t>(0)]Po{ X  €  dx) 

(2.1)  =  exp[0r  -  <t>{9)) exp[£0*  -  A't(Co)]P{A'  -  <  G  dx}. 

(Since  (see  (1.4))  <£(0)  =  0,  the  definition  of  Po  is  consistent  with  (1.3).)  The  corresponding  cgf 
<(>e  is  given  by 

<>6{T])  =  <3(0  +  V)  ~  d>(0)  =  A'*($ 0  +  6  +  1})  -  A't(f0  +  9) 

(2.2)  =  K((o+0  +  n)-  K(Zo  +  9)-(n- 

In  particular. 

EeX  =  di(0)  =  <t>'(9)  <,=,  or  >0 

(2.3)  according  as  9  <.=,  or  >0 

by  (1.5)  and  the  strict  convexity  of  6. 

We  shall  have  particular  interest  in  the  values 

(2.4)  0O  =  -€o  <  0  (recall  (1.7)),  0j  =  &  -  Co  >  0 
(the  latter  being  defined  only  if  assumption  1'  is  met),  which  satisfy 

(2.5)  <t>(60)  =  <5(0i )  =  -A'ctfo)  =  -(A'tfo)  +  <#o). 

As  special  cases  of  (2.1), 

P0  is  given  by  (1.3), 

Pe ,  {X  €  dx)  =  exp(?,x)P{A  -  <  €  dx). 


and 


(2.6)  P6o{X  e  dz)  =  P{X  -  <  edx}. 

Thus  we  can  write  our  fundamental  probabilities  (1.1)  and  (1.2)  in  the  forms 
(2-7)  P{Sm  >  g(m)}  =  Pg0{Sm  >  a}, 

(2.8)  pm  —  Pg0{Sn  >  a  for  some  n  >  m). 

Without  loss  of  generality  we  take  Pg  itself  to  be  the  distribution  of  Aj,  Aj, . . .  defined  on 
the  space  of  (infinite)  sequences  of  real  numbers.  Accordingly,  let  pjn)  denote  the  restriction 
of  Pg  to  the  tr-algebra  generated  by  the  first  n  coordinates  (n  =  1,2,...).  Then  for  any  O'  and 
9",  Pgi  and  Pg"  are  mutually  absolutely  continuous,  and  by  (2.1) 

dP{n) 

(2.9)  =  exp{(0'  -  0")Sn  ~  nW)  -  <j>(0")}}. 

dPgii 

In  particular,  by  (2.4).  (2.5).  and  (2.9), 

dp <”) 

(2-10)  _^  =  exp(^l5n)  („  =  1,2, . . .). 

2.1.  Proof  of  (1.20).  The  idea  is  to  tilt  from  P$0  in  (2.7)  to  the  distribution  Pq  under 
which  A'  (and  hence  each  Sm )  has  mean  zero  (recall  (2.3))  and  then  apply  the  (local)  central 
limit  theorem  (CLT)  for  lattice  distributions.  According  to  (2.9)  and  (1.7) 

(2.11)  P{Sm  >  s(m)}  =  Pg0{Sm  >  a}  =  exp(-m^o))JP0(exp(-|«o|^m);  Sm  >  a). 

The  analysis  of  £o(exp(-|0o|Sm);  Sm  >  o)  can  be  carried  out  just  as  for  £o(exp(^5m); 

Sm  <  hk)  in  Siegmund  (1975,  lemma  1(b));  the  result  is 

(2.12)  £0(exp(-j^o|5rT1);5m  >  a)  -  C(2ff<rJm)'1/2exp(-|tf0|o)(l  +  em). 

Combination  of  (2.11)  and  (2.12)  gives  (1.20)  immediately. 
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We  remark  that  the  corresponding  result  for  the  events  {5m  >  p(m)}  is 


(2.13)  P{Sm  >fl(m)}~am(l  +  em) 
where 

(2.14)  im  =  1  —  fractional  part  of  h-1(6m  —  g(m)), 

(2.15)  Cm  =  exp(|0oMm)  -  1. 

The  probabilities  P{Sm  >  g(m)}  and  P{Sm  >  g(m)},  and  likewise  the  right  sides  of  (1.20) 
and  (2.13),  differ  only  when  g(m )  is  a  point  in  the  lattice  for  Sm.  In  that  case  the  right  side  of 

(2.13)  is  larger  than  the  right  side  of  (1.20)  by  the  factor  exp(|0o|fi)-  This  remark  generalizes 

(4.2.13)  in  Fill  (1980). 

2.2.  Proof  of  (1.21).  Let 


(2.16)  Tm  =  inffn  :  n  >  m,Sn  >  a}, 
the  inf  of  the  empty  set  being  +oc.  Then  by  (2.8) 

(2.17)  pm  =  P*0{Sm  >  a}  +  Pe0{m  <  Tm  <  oc)  =  P{Sm  >  s(m)}  +  Pe0{m  <Tm<  oc}. 

The  first  term  was  analyzed  in  Section  2.1;  the  result  is  (1.20).  For  the  second  term  we  use  the 
approach  of  Siegmund  (1975)  exploited  also  by  Fill  (1980,  1983): 

(a)  Tilt  from  P»0  to  using  the  fundamental  identity  of  sequential  analysis  (FISA),  and 
simplify  using  the  SLLN. 

(b)  Apply  the  weak-law  result  (2.13)  to  estimate  P$}  { Sm  <  a}  and  to  approximate  the  condi¬ 
tional  distribution  under  Pe j  of  5m  given  Sm  <  o. 

(c)  Complete  the  proof  via  renewal -theoretic  calculations. 

The  first  two  steps  are  routine;  the  last  involves  a  considerable  complication  of  Siegmund’s 
arguments  and  is  the  object  of  Section  2.3  below. 


Step  (a)  is  carried  out  just  as  for  (22)-(23)  in  Siegmund  (1975).  The  result  is 

Pea{m  <Tm  <  00}  =  exp(-£1o).E01(exp[-£|(Sjm  -  a)];m  <  Tm  <  00) 

=  exp(-£ia)£ei(exp[— £j(Srm  -  a)];  Sm  <  a) 

=  exp(-^a)Pfil{5m  <  q} 

x  £ei(exp[-^(5Tm  -  a)]  |  5m  =  0  -  y)P6i  { Sm  €  a  -  dy  \  Sm  <  0} 

(2.18)  =exp(-^o)Pei{5m  <a) 

x  /  E0l  exp[-£i(ST(j,)  -  y)]P6i  {a  -  Sm  €  dy  \  Sm  <  a} 

•/[Cl.oc) 

where,  for  y  >  0.  r(y)  =  inf{n  :  Sn  >  y}. 

Next  we  perform  step  (b).  The  result  (2.13)  can  be  applied  to 

Pe^Srr,  <  a}  =  Pfi,  |^[^JJ1(-A’'/:  +  //*,)]  >  -O^o  +  CT~1/j(9j  ^ 
directly,  where 

Wi  =  E6l X  >  0  (recall  (2.3)-(2.4)),  =  Var^Y  >  0. 

However,  it  is  probably  easier  to  start  afresh  and  perform  calculations  (tilt  from  Pe ,  to  P0, 
apply  the  CLT)  parallel  to  those  for  (2.13)  or  (1.20).  Either  way  one  finds,  making  use  of  (2.5). 

(2.19)  P6l{Sm  <  o}  ~  [exp(|0oj/O  -  1][1  -  exp(-<?,h)]-1  exp[(0j  +  |0o|)a]am  exp(-M6,n)- 
Similarly,  for  each  fixed  j  £  TL 

(2.20)  P?,{q  -  5m  >  h(j  +  £m)}  ~  expf-Mj)  x  (right  side  of  (2.19)). 

Dividing  (2.20)  by  (2.19)  we  obtain  the  analogue 

(2‘21)  J^J^P^ii01  ~  sm  >  h{j  +  6m)\  Sm  <  a}  =  ex^-Bihj)  (j  =  0,1,...) 

to  (38)  in  Siegmund  (1975).  In  words.  (2.21)  says  that  under  P6,  the  conditional  distribution 
of  Q  -  Sm  -  h6m  given  Sm  <  a  converges  to  the  geometric  distribution  with  probability  mass 
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function  given  by 

,*Vl 

[1  -exp(-<?i/i)]exp(-^hj)  (j  =  0,1,...). 

'  ‘ 

It  follows  that  the  last  integral  appearing  in  (2.18)  equals 

J 

•>;y 

-,vy 

(2.22) 

[1  -  exp(-M)]exp {exh6m)Z'm  +  o(l), 

$ 

where  we  define  for  x  >  0 

• .  *, 

•Y 

(2.23) 

Z(x)  =  Efft  exp[-fi (5t(i)  -  i)] 

$! 

and  for  each  r? 

j 

(2.24) 

Bn  =  {h(j  +  f>n)  :  j  6  TL  }  =  (lattice  for  £«,(a  -  5„)), 

;? 

i 

(2.25) 

Z;  =  £  Z(x)exp{-61x). 

*«v 

Notice  that  when  assuption  2b'  is  met,  Bn  =  B  consists  of  the  multiples  of  h  and  Z‘  s  Zm 

3s 

■:«>! 

reduces  to  (the  lattice  version  of)  Zm{6\)  in  Siegmund  (1975).  In  Section  2.3  below  we  show 

(2.26) 

Zmm  =  [expCI^ol*)  —  1]  Ml  +  0  +  ”>  )*".  -  «m]. 

"M 

»VY 

«:<v 

Combining  (2.18).  (2.19),  (2.22)  and  (2.26)  we  then  find 

I'Tt 

LI 

(2.27) 

Pe0{m  <Tm<  oo}  =  am[7  +  (1  +  7)Am  -  em  +  o(l)j. 

•y 

t1** 

<y 

Thus  by  (2.17)  and  (1.20) 

'.4* 

'  *  V 

.  V 

(2.28)  pm 

—  Om [( 1  +  7  )(1  +  )  +  °( 1 )]  =  ( 1  +  o{  1 ))( 1  +  7  )am(  1  +  Am ), 

»•# 

.* -V 

t-  *’» 

which  is  (1.21). 

•ij!' 

Before  examining  the  proof  of  (2.26)  we  close  Section  2.2  w'ith  two  remarks  concerning 

(1.21). 

V:a? 

11 

ZT 

:  '  ■'  V-  .-Mv  1 

Remark,  (a)  One  can  show  that  for  fixed  o  eIRthe  last  integral  appearing  in  (2.18)  equals 
(2.22)  uniformly  for  c  6  (0,  fj],  where  is  any  e  >  0  for  which  assumption  1'  is  met.  This 
generalizes  a  remark  of  Siegmund  (1975). 

(b)  (2.13)  has  the  strong-law  counterpart 


(2.29) 


Prn  ■•=  P{Sn  >  g(n)  for  some  n  >  m}  ~  (1  +  7)am(l  +  Am), 


where  Am  is  defined  by  the  right  side  of  (1.16)  when  em+n  there  is  replaced  by  em+n  of  (2.14)- 
(2.15).  Am  is  bigger  than  Am  by  the  amount  (1  +  7)-1  exp  [-  n~1P{S„  >  cn}]  [exp(|0o|h) 

—  1]  times 


(2.30) 

When  assumption  2b'  is  met,  (2.30)  equals 


">0:6m+n=0 


n=0 


(2.31) 
so  that 

(2.32) 


Y^Un  -  «(i)=«xp 

= (1 +  7)exp 


]T  n_1  exp(-7i<>(«0))/>o{5n  >  0} 

«!S1 

^n_,P{S„  >  cn} 


TJSl 


pt  ~exp(|0o|fc)Pm, 


which  is  (4.2.14)  in  Fill  (1980).  At  the  other  extreme,  when,  for  example,  a  =  0  and  fi~l(r  —  b) 
is  irrational,  (2.30)  vanishes.  Indeed,  we  have  in  that  case  =  pm  for  every  m.  | 

2.3.  Proof  of  (2.26):  renewal-theoretic  calculations.  Define  G  to  be  the  distribution 
of  ST(0)  under  P^1 ,  with  Laplace  transform 


(2.33) 

For  each  n  define 


G*(A)  :=  E$t  exp(-AST/0))  =  /  exp(-Ai)G(dx). 

J(  0,oo) 


Gn(y)  =  Pet  (r(0)  =  n,  Sn  <  y}. 
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(2.34) 


(2.35) 


G„(A)  =  £«]  (exp(-AST(O));r(0)  =  n)  =  /  exp(-Ai)Gn(</x). 

J (0,oc) 


As  Siegmund  shows  (when  a  =  0) 


(2.36) 


2'  =  |fl0r1[(T(tfi)-<r(ft)]  +  Z-G-(«I) 


for  Z *  :=  /(0  oo)  Z(x)exp[-6ix)dx  in  case  2a  and  (tacitly) 


(2.37) 


Z*  =  [exp(|4>| h)  -  l]— 1  [G*(^i )  —  G*(6)]  +  Z-G’Wx) 


for  Zm  (like  Bn.  independent  of  n)  given  by  (2.25)  in  case  2b',  so  we  shall  derive 


(2.38) 


2m  ~  +  ‘y  \  2m+ngn.  m  >  1. 


in  the  present  situation,  where  for  each  m  >  0 


(2.39) 


9m  ■=  Gm(® i)  (in  particular,  g0  =  0), 


(2.40)  rm  :=  [exp(|0o!M  -  )  ~  <?"(*,)  +  Y,  “  *«G"(6)]- 


Here  is  the  argument  leading  to  (2.38).  Begin  with  the  following  renewal  equation  for  the 
function  Z  of  (2.23): 


Z(x)  =  f  exp[-h(y- x)]G(dy)+  I  Z(x  -  y)G(dy) 

J(t,  oo)  •'(O.r) 

oo  r 

=  S  exp[-€i (y -  x)]P6i {ST(0)  =  y; r(0)  =  n } 

n=0  *•  y.y>z,  o-y£Bn 

+  £  2(x -y)Pei{Sr(o)  =  y\r(0)=  n)  ; 

ii>A X •  < ^  «•  19  * 


y:0<y<r.  o-y€Bn 


compare  (26)  in  Siegmund  (1975).  Multiply  both  sides  by  exp(— (?ix),  sum  over  values  x  satis¬ 
fying  0  <  x  €  Bm.  and  apply  to  the  second  sum  on  y  the  observation  that  when  a  —  y  G  B„. 


y'vtvts 


x  €  Bm  if  and  only  if  x  -  y  6  Bm+n 


to  conclude 


zm  =  exp(-6y)^  {5t(0)  =  y;  r(0)  =  n} 

n=0  *•  y:y>0,  a-yCBn 

*  H  exp(|«o|x)  +  Z;+nffn 

jr:0<r<y,  xgB 

m 

Now  the  sum  on  x  here  equals  [exp(|0o|h)  -  l]-1(l  +  em)  times 

exp(|0o|h  \h~ly  —  #mD  -  1  =  (1  +  em)-1  exp(|d0!y)exp[|d0|h([‘h_1y  -  £ml  -  (/i_1y  -  6m))]  -  1, 

and  \h~*y  -  -  (h~ly  -  6m )  is  for  a  -  y  6  Bn  the  fractional  part  of  each  of  the  numbers 

tm  -  h_1y  =  fm  -  /i-1a  +  h~1(a  -  y).  im+6n-  h-1a,  and  h-,(y(m  +  n)  -  b(m  +  n))  -  namely, 
^m+n-  XhuS 

X]  exp(|0o|*)  =  [exp(!4o|A)  -  1]"*[(1  +  em+n)exp(|0o|y)  -  (1  +  em)], 

x:0<r<y.  x€fim 

and  (2.38)  now  follows  directly. 

Whereas  solving  (2.36)  or  (2.37)  for  Zm  is  a  trivial  matter,  solving  (2.38)  requires  some 
work.  We  observe  first  that  the  sequence  (ym)m>o  is  a  sub-probability  mass  function  with  total 
mass  G'(Oi)  <  1.  and  that  the  sequences  (xm)  and  (Z„)  are  bounded.  Let  u  be  the  renewal 
mass  function  associated  with  g.  to  wit: 

(2-<l)  =  f >«, 

j=0 

where  is  the  jth  convolution  power  of  g,  g ^  placing  unit  mass  at  0.  We  show  below  that 
(um)  has  generating  function  u  given  by  (1.17).  Applying  the  method  of  successive  substitutions 
to  (2.38)  in  the  same  way  that  one  discovers  the  solution  to  a  renewal  equation,  one  finds  that 

PC 

(2.42)  Zm  =  2>m+n«„,  tn  >  1, 

n=0 

the  series  converging  absolutely,  is  the  unique  bounded  solution  to  (2.38). 

We  shall  reduce  (2.42)  to  (2.26).  but  first  we  calculate  the  generating  functions  for  the 
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sequences  g  and  u.  The  generating  function  for  g  is 


(2.43) 


$(“•)  =  Y29nU'n  =  £f,(exp(-0iST<o));T(O)  =  n)u>” 

n=0  n=l 

=  £*1[trT(o)exp(-0iST(o))]. 


According  to  a  result  of  Spitzer  (compare  Chung  (1974,  theorem  8.4.2)) 


(2.44)  1  -  £^[u-T(0)exp(-A5T(0))]  =  exp 


-J> ,kk-lEtl{€-xs';Sk>0) 

L  fc=i 


Equations  (2.43)  and  (2.44)  are  valid  for  all  complex  u •  with  |u'|  <  1.  From  (2.9)  and  (2.5) 
follows 


(2.45) 


£ei(e-e’5*;SA.  >  0)  =  exp(-k<t>($0))P0{Sk  >  0}. 


Combining  ( 2.43 )-( 2.4o ). 


(2.46) 


g(u-)=  1  -  exp 


-  Y2  u'kk~1  exp(-kti>(Oo))P0{Sk  >  0} 

fcss  1 


U’l  <  1. 


Now  by  (2.41),  fi(tr)  =  (1  -  g(u-))~l .  and  (1.17)  is  established.  In  particular.  (2.31)  holds. 
Combining  (2.42).  (2.40).  (2.31),  and  the  consequences 


(2.47) 


1  -  Gm(6 1 )  =  exp 


-  Y2  k  l  exp(-fc<>(0o))£o{S/t  >  0} 

,  *=i 


(2.48)  1-G*tfi)  =  exp 

of  (2.44),  (2.45),  and  (2.6),  we  find 


(2.49) 
where 

(2.50) 


Z'm  =  [expfltfolM  -  1] 


-l 


~Y2^~lp{Sk  >  e*} 

fc=l 


4"  ^m+nffn  —  vmG  ($l) 
n=l 


l'm  ■ =  em+nun. 


T)=0 
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But  by  (2.41) 

oc  oc  oc 

(2.51)  ^  t-'m+nfln  =  Cm+n(ti  *  9)n  —  ^  "  ^m+nMn  =  ®m  —  cm> 

n=l  n=0  n=l 

so  by  (2.48)-(2.51)  and  the  definition  (1.16)  of  Am,  (2.26)  holds. 


*' 


s 


3.  Theorem  1  when  r  =  h  l(c  -  b)  is  irrational. 

In  this  section  we  examine  Theorem  1  under  the  assumption  that  r  =  h-1(c-6)  is  irrational. 
Specifically,  we  first  recall  that  the  sequences  (em)  and  (Am)  appearing  in  (1.20)  and  (1.21)  take 
values  in  the  interval  [O.exp(|0o|h)  -  1)-  We  shall  now  say  how  the  values  of  each  sequence  are 
distributed  over  this  interval.  We  shall  use  this  information  to  compute  the  respective  limits  as 
M  —  oc  of  the  average  values  M~ 1  cm  and  A/-1 

Recall  that  a  sequence  (rm)  of  real  numbers  is  said  to  have  distribution  F  if,  letting 
m(M)  be  a  random  variable  uniformly  distributed  on  {l,...,A/},  the  random  variables  £m(A/) 
converge  in  distribution  to  F  as  M  —  oc.  If,  in  particular,  F  is  the  uniform  distribution  on  an 
interval  I,  ( xm )  is  said  to  be  equidistributed  over  I. 

According  to  a  well-known  result,  the  sequence  6m  =  [fractional  part  of  (h~*a  +  rm)]  of 
(1.14)  is  equidistributed  on  [0.1).  Thus  the  distribution  of  the  sequence  (em)  of  (1.15)  is  that 
of 

(3.1)  V  =  exp(|0o|fctr)-  1, 

where  V  is  uniformly  distributed  on  [0,1).  In  particular. 

M 

(3.2)  €.m  :=  A/"1  cm  ^£[exp(|0o|/»t-)-l]  =  (|W1[exp(|tfo|ft)-l]-l  =(NC)-1 -1 

m  =  l 

with  C  given  by  (1.13b).  It  is  interesting  to  note  that  the  corresponding  average  C(1  +  Z.\t) 
of  the  coefficients  C(1  +  em)  multiplying  the  expression  (27r<T2m)_1/2exp(— m<f>(0o)  -  |0o|a) 
(1.20)  tends  as  A/  —  oc  to  the  constant  coefficient  |0o|_1  multiplying  the  same  expression  in 
(1.9)  in  the  non-lattice  case. 

We  next  characterize  the  distribution  of  (Am).  We  begin  by  recalling  from  (1.16)  that  Am 
can  be  written  in  the  form 

oc  oc 

(3.3)  Am  =  em+nu°  =  Eem+W  =  ]T[exp(|0o|M*m  +  »r>)  -  l]u°, 

n=0  n=0 
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where  IF  is  a  random  variable  with  probability  mass  function  (pmf) 

(3.4)  u°:=un/u(l),  n  =  0, 1, . . 

and  where  (x)  for  real  x  denotes  the  fractional  part  of  x.  Since  the  mapping  t  :  [0, 1)  —»  (0, 1)°° 
defined  by 

<(“)  =  (u,(u  +  r),(u  +  2r),...)  (u  €  [0,1)) 

is  continuous  except  at  a  countable  number  of  points,  it  follows  easily  that  the  distribution  of 
(Am)  is  that  of 

OC 

(3.5)  V  =  £[exp(!0oIMlr  +  nr))  -  l]u°  =  E[exp(\90\h(U  +  IFr))  |  U]  -  1, 

71  =  0 

where  V  unif[0, 1)  and  IF  with  pmf  (u°  )n>o  are  independent  random  variables.  In  particular, 
M 

(3.6)  A m  :=  A/"1  ^  Am  -  E  exp(\0o\h(U  +  H'r))  -  1  =  £exp(|«0|At')  -  1  =  (l^olCT1  -  1. 

771  =  1 

In  (3.6)  we  have  used  the  well-known  fact  that  (U  +  Y)  ~  unif[0, 1)  when  V  ~  unif[0, 1) 
and  Y  are  independent.  The  average  C(1  +  A*/)  of  the  coefficients  C(1  +  Am)  multiplying  the 
expression  ( 1  +-)  )(2-a2m)~1^2  exp(-m<i>(0o)  -  |0o|a)  in  (1-21)  tends  as  M  —*  oo  to  the  constant 
coefficient  |0O'_1  of  the  same  expression  in  (1.10)  in  the  non-lattice  case. 
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4.  Theorem  1  when  r  =  -  b)  is  rational. 

In  this  section  we  examine  Theorem  1  under  the  assumption  that  r  =  h~l((-b)  is  rational. 
The  main  achievement  here  is  to  express  Am  of  (1.16)  explicitly,  rather  than  implicitly  through 
the  generating  function  ti  of  (1.17).  We  also  show  that  each  of  the  sequences  (em)  and  (Am) 
cycles  through  only  q  distinct  values,  where 

(4.1)  r  =  h~l((  -  b)  =  p/q  in  lowest  terms  (p  €  TL  ,q  €  TL  ), 
and  we  show  that  the  average  of  the  q  values  is  in  either  case 

(4.2)  e  =  A  =  exp(j0o|M-1O  *  ^'[exp^ol^*1)  -  l]-1[exp(|0o|>»)  -  1]  -  1 
with 

(4.3)  £  :=  fractional  pait  of  [9  x  (fractional  part  of  h_1o)]. 

According  to  (1.16),  (Am)  is  a  constant  multiple  of  the  more  simply  defined  sequence  (tm) 
of  (2.50).  so  we  shall  work  with  the  latter.  Clearly  each  of  the  sequences  (6m),  (em),  (Am),  and 
(vm)  is  periodic  with  period  q.  We  shall  write 


(4.4) 

w  =  e2r,/? 

and 

9-1 

(4.5) 

n-  =  ?_1  51  xiu~3k 

1-0 

for  the  discrete  Fourier  transform  of  a  periodic  sequence  ( Xj )  with  period  q.  The  inverse 
transform  to  (4.5)  is 

9-1 

(4.6)  Xj  =  ^iku>,k. 

k=0 


We  can  write 


where 


tty  :=  ^  «*• 

0<«=-<  (mod  9) 

That  is,  r  is  the  convolution  of  the  periodic  sequences  e  and  tv.  Now  the  sequence  w  has  Fourier 
transform 


so 


wk  =  q~l  Unukn  =  g_1u(wfe), 

n=0 

h  -  qtkWk  = 


and  therefore 
(4.8) 


v,  = 

fcaO 

The  factor  u(w,<c)  appearing  in  (4.8)  can  be  explicitly  presented.  According  to  (1.17), 

OC 

(4.9)  fi(u>*)  =  exp  ^u,-*nn~1  exp(-n^(0o))Fo{S„  >  0} 

In  summary, 

(4.10)  Am  =  (1  +  ')-1  exp  [-  ^2  I 


n  =  l 


9-1 


(kf 


n=l 


2n  km/q 


exp 


k—0 


ge2^n/«n-lexp (-n*(0o))Po{S„  >  0} 


L  nal 


where 

(4.11) 


9-1 

ik  =  9"l]TejC-2*”fc/«. 

j-0 


In  case  2b',  q  =  1,  e*  =  0,  and  Am  =  0  (as  already  noted  prior  to  (1.18)).  The  factor  (4.11)  can 
be  simplified  in  certain  other  special  subcases  of  assumption  2b,  for  example,  a  =  0  and  p  =  1. 
Indeed,  we  have  then  by  (1.14)  h_,(q(m)  -  bm)  =  rm  =  m/q,  and  so  6m  =  q~l  x  (m  mod  q) 
and 

9-1 

=  9"1  j)  “  l]*~jk 

j- o 

=  9-1[exp(|^o!*)  -  lJIexpd^ol^'1  V*  -  1]_1  -  60,k, 
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where  here  S0,k  =  0  or  1  according  as  k  ^  0  or  k  =  0. 

We  turn  our  attention  to  the  distribution  of  values  of  (em)  and  of  (Am).  As  m  increases, 
em  cycles  through  the  values 

(4.12)  exp[|0o|A  x  9-1(C  +  j))  ~  1*  j  =  0,...,q-  1, 

though  not  necessarily  in  this  order.  The  average  of  these  q  values  is  given  by  (4.2).  The  q 
periodically  repeating  values  of  the  sequence  (Am)  are  presented  explicitly  in  (4.10)-(4.11). 

The  average  of  any  q  consecutive  values  of  v  is 

00 

r0  =  e05(l)  =  e(l  +  7)  exP  ^n-1F{S„>cn}  , 

,  n= 1 

so  the  corresponding  average  for  A  is  e. 


5.  Small-c  analysis. 

Leaving  aside  the  issue  of  how  in  general  to  compute  the  exact  probabilities  P{S„  >  cn } 
and  Po{Sn  >  0},  when  c  is  small  the  constant  7  =  7(c)  of  (1.12)  that  appears  in  (1.10)  and 
(1.21)  is  difficult  to  compute  because  of  the  quite  slow  convergence  of  the  series  in  (1.12).  In 
Section  5.1  we  provide  an  approximation  to  7  valid  for  any  distribution  £,  non-lattice  or  lattice, 
when  €  is  small.  More  precisely,  assuming  only  that  assumption  0  is  met  and  0  6/°,  we  show 
that 

(5.1)  7(c)  =  1  -  (p(f)  -  k/3)c  +  0(c2), 
where 

(5.2)  k  :=  EX3 
is  the  third  cumulant  of  F  and 

(5.3)  p(f)  :=  £*,  £*,  ST(o), 

and  that 

(5.4)  p(e )  -  p( 0)  :=  ES2t{0)/ESt{0). 

Thus 


(5.5)  7(c)  =  1  -  (p(0)  -  k/3)c  +  o(e). 

Spitzer  (1960)  and  Lai  (1976)  have  shown  how  £ST(0)  and  £S2^ 0)  can  be  computed;  see  equa¬ 
tions  (1.2)  and  (1.5)  in  Lai  (1976).  Consequently, 


(5.6)  p(0)  =  2 x'2p2  +  k/3  -  2  f;  n-,/J[£(n-1'J5n)-  -  (2*)"1'2], 

ns] 

where 


(5.7) 


nsl 


0.8239168 
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is  the  value  of  £S2^  (an^  2*/2p2  =  1.1651943  is  the  value  of  p(0))  when  F  is  the  standard 
normal  distribution  function.  Lai  (1976,  theorem  1)  has  shown  that  the  series  in  (5.6)  in  fact 
converges  absolutely.  An  alternative  formula  for  p(0),  better  suited  for  numerical  calculations, 
has  been  given  by  Siegmund  (1985,  theorem  10.55  and  problem  10.7): 

(5.8)  p(0)  =  k/3  -  2*-1  /°°  A"2  Re  log{2[l  -  /(A))/A2}dA, 

Jo 

where  /  is  the  characteristic  function  corresponding  to  F. 

We  return  now  to  the  lattice-case  setting  of  Theorem  1.  Exact  computation  of  the  Am's 
of  (1.16)  is  even  more  difficult  than  that  of  7.  Even  in  the  relatively  simple  situation  that 
r  =  h~l(t  -  b)  is  rational,  calculation  of  the  sequence  (Am)  requires  the  evaluation  of  each  of 
the  q  slowly  converging  (when  (  is  small)  series 

OC 

(5.9)  e2r,kn^qn~l  exp(-nd>(0o))Po{Sn  >  0},  k  =  0, 1.  •  •  •.  q  -  1. 

n=l 

The  main  result  of  Section  5.2  establishes  the  strikingly  simple  approximation  Am  =  c/i/2  for 
all  in  made  precise  by  (1.26)  above. 

5.1.  Small-e  anlaysis  of  7.  Throughout  Section  5.1  we  suppose  that  assumption  0  is 
met  and  that  0  €  7°.  so  that  assumptions  1  and  1'  are  met  for  all  small  f.  One  can  easily 
establish 

1  -  +  0(c2)  ,  £1  =  2f  l-^«f  +  0(e2)  . 

We  begin  the  proof  of  (5.1)  by  recalling  from  (1.12),  (2.33),  and  (2.47)-(2.4S)  that 
(5.11)  *7  =  [1  —  E6l  e.\p(-fr5T(0))]/[l  ~  E$,  exp(-0iST(O))]  -  1. 

It  then  follows  from  Lemma  1  below  and  (5.10)  and  the  definition  (2.4)  of  9\  that 

7  =  ZiE6iSTiQ)  -  \&EtlS2m  +  0(<3)]  j  [#iJ5V,St(o)  -  ^E$i  S2(0)  +  0(<3)]  -  1 
=  6-^iV(0  +  O(f3)]y/[(?i  -^?p(c)  +  0(e3)  -1 
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a 


(5.12) 


(6  ~  *i)  ~  5K?  -  «?)***)  +  0(e3)]  /  [*i  -  |^P(6)  4-  0(f3) 
1  -  (/>(€)  —  k/3)<+  0(f2), 


and  (5.1)  is  established.  The  result  (5.4)  also  follows  from  Lemma  1. 

We  state  without  proof  a  further  asymptotic  development  of  7  for  two  specific  choices  of 
F .  \\  hen  F  is  the  standard  normal  distribution  function,  the  remainder  term  in  (5.5)  equals 
(1  +  o(l))(l  +  p2(0))e2/4  (recall  p(0)  =  1.1651943  in  this  case).  When  F  puts  mass  1/2  each  at 
±1.  so  that  5  is  simple  symmetric  random  walk,  we  have 

”)(c)  =  1  -  e  +  (1  +  o(l))ce3/2, 


where 

c  =  \  (t)  £(4[(j  +  1)3/2  ~  j3/2]  -  3[(j  +  l)1/2  +  j1'2))  =  0.6634768. 

V  J  j=0 

For  the  cases  of  X  -  standard  normal  and  P{A'  =  ±1}  =  1/2  and  selected  values  off,  the 
following  table  lists  *,  =  •,(()  along  with  the  errors  in  the  corresponding  approximations  7(f)  = 
1  -  p(0)e  +  (1  +  p2(0))c2/4  (normal  case)  and  7(f)  =  1  -  c  +  ce3/2  (Bernoulli  case). 


A'  - 

standard  normal 

P{A 

CN 

e-4 

II 

-H 

II 

f 

5 

A  =  7  -  7 

A/e3 

5 

> 

1 

II 

->> 

1 

-> 

A/e2 

.300 

.6988447 

.0046448 

.172 

.7579655 

.0510548 

.567 

.200 

.7891308 

.0014071 

.176 

.8345596 

.0247836 

.620 

.100 

.8891949 

.0001799 

.180 

.9148624 

.0061186 

.612 

.050 

.9431911 

.0000227 

.182 

.9558413 

.0015766 

.631 

.025 

.9712357 

.0000029 

.183 

.9772209 

.0004017 

.643 

.010 

.9884068 

.0000002 

.184 

.9905982 

.0000652 

.652 

In  Lemmas  1  and  2  below  we  write  r  for  the  first  ladder  epoch  t(0). 
Lemma  1.  For  any  real  r  >  0 


(5.13) 


Eg  j  S'  — *  ESI  as  c  |  0. 


Proof.  We  first  relate  the  left  side  of  (5.13)  to  the  original  random  walk: 


£SlS;  =  £«0[S;exp(frST);r  <  oc] 


(5.14) 


=  E[Yr  exp(hY):T  <  oc}. 


Here  T  is  the  epoch  of  first  exceedance  of,  and  Y  =  Sj  -  <T  is  the  overshoot  of,  the  linear 
boundary  with  slope  c  passing  through  the  origin.  The  limiting  relation 

yrexP(6V)/{T<oo}  —  s; 

clearly  holds  for  (almost)  every  sample  point,  so  it  suffices  to  show  that  the  function 
£[y'2r  exp(2£i y);T  <  oc]  =  £s0[52r  exp(2£i ST);r  <  oc] 
of  c  is  bounded  for  small  c. 

For  this  we  use  Lemma  2  below.  From  assumption  0  it  follows  that  EX~  >  0.  Choose 
c  €  (O.oc)  large  enough  that  E(X~  A  c)  >  0.  Apply  Lemma  2  with  /(x)  =  x2rexp(2fjx)  to 
conclude 

(5.15)  0  <  £*0[S2rexp(26ST);r  <  oo]  <  £*0[(A'+)2rexp(26A'+)(A'+  +  c)]/£*0(A’-  A  c). 

As  (  ]  0,  the  last  expression  in  (5.15)  will  by  the  dominated  convergence  theorem  approach 

£[(A'+)2r(A'+  +  c))/E(X-  A  c)  <  oo.  | 

Let  (Sn)n> o  be  any  random  walk  with  liminf  Sn  <  +oo.  (When  EX  G  [-oc,oc]  exists  this 
is  equivalent  to  £A’  <  0,  so  our  given  (5„)  is  such  a  walk  under  Pe0.)  Lemma  2  provides  simple 
upper  bounds  on  certain  functionals  of  the  first  ladder  height  ST.  In  the  course  of  proving 
Lemma  2  we  shall  make  use  of  the  observation  that  if  (£(*))  =  (EN(t))  is  the  renewal  function 
for  a  persistent  renewal  process  N  (convention:  AT(0)  =1)  with  interevent  distribution  AO- 
then  for  any  t  >  0  and  c  >  0 

(5.16)  U(t)<{t  +  c)/E{t  Ac). 

Indeed,  if  we  suppose  at  first  that  £  <  c,  then  clearly  0v(«)  <  <+c-  and  (5.16)  follows  from  Wald’s 
identity  £5,v(()  =  (£0  x  U(t).  The  boundedness  condition  on  (  can  then  be  removed  by  a 
simple  truncation  argument.  When  N  is  the  renewal  process  corresponding  to  (the  magnitudes 
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of)  the  (weak)  descending  ladder  heights,  (5.16)  yields 


(5.17) 


U(t)  <  (t  +  c)/E(X~  A  c) 


£(|ST_|  A  c)  >  £(|SrJ  A  c;  r_  =  1)  =  E{X~  A  c); 

here  r_  =  inf{n  >  1  :  5„  <  0}  is  the  (almost  surely  finite)  first  descending  ladder  epoch. 

Lemma  2.  Let  (5n)n>0  be  any  random  walk  with  liminf  5n  <  +oo.  If  f  :  [0,  oo)  — »  [0,  oc) 
is  measurable  and  nondecreasing,  then  for  any  c  >  0 


(5.18) 


E[f(Sr)-,  r  <  oo]  <  E[f(X)(X  +  c); X  >  0)/E(X~  A  c). 


Proof.  Since  ST  >  0  over  {r  <  oo},  we  may  suppose  /( 0)  =  0  and  establish  (5.18)  in  the 


(5.19) 


£[/(ST):  r  <  oo]  <  E[f(X+)(X+  +  c)\/E(X~  A  e). 


In  light  of  (5.17)  it  is  enough  to  show 


(5.20) 


£[/(5T);r<oo]<£[/(X+)r(A'+)]; 


here  U  is  the  distribution  function  for  the  renewal  measure 


(5.21) 


u(<iy)  =  ^2  e  y 6  l°* °°)» 


r_  denoting  the  fcth  descending  ladder  epoch.  The  duality  result 


(5.22) 


P{ST  e  B\  r  <  oo}  =  /  U(dy)P{X  £B  + 
J[ 0,oo) 


is  well-known;  it  can  be  proved  by  employing  proposition  8.38  and  the  version  -  valid  for  any 
random  walk  - 


(5.23) 


£{5t+  >  x:t+  <  oo}  =  J2  /  Pir+  >  n'Sn  e  dy}p{X  >  x  ~ 

n=0 


’  *i9  Vj’isV. 


of  (8.85)  in  Siegmund  (1985).  From  (5.22)  follows 


E[f(ST);r<  oc]=  /  /  f(s)P{X  -  y  €  ds)U(dy) 

./[O.oo)  J( 0,oc) 

=  /  Ef({X-y)+)U(dy)  (recall /(0)  =  0) 

•/(O.oo) 

=  E  I  /(( *+  -  y)+)U(dy) 

J[ 0,oo) 


=  £  /  /(A’+  -  y)£(dy) 

•/(0.X  +  ) 

<  £[/(.Y+)t/(A'+)], 


the  inequality  holding  because  /  is  nondecreasing. 


5.2.  Small-e  analysis  of  (em)  and  (Am).  Throughout  Section  5.2  we  suppose  that 
assumptions  0  and  2b  are  met  and  that  0  6  7°.  We  shall  spend  little  effort  examining  the 
sequence  ( em )  since  its  computation  via  ( 1 .14)— ( 1 .15)  is  quite  simple.  The  following  two  remarks 
shall  suffice,  (i)  For  fixed  m,  as  t  j  0  the  quantity  h~l(g(m)  -  bm)  decreases  to  h~l(a  -  fcm); 
it  follows  that  fm  =  ^m(f ),  and  hence  also  the  ratio  of  em  =  em(c)  to  (h  converges  to  6m(0)  := 
fractional  part  of  fi-1(a  -  bm).  Note,  however,  that  the  convergence  of  em/(e/i)  to  £m(0)  is 
not  uniform  in  m.  (ii)  If  V'  =  V(e)  is  a  random  variable  having  the  same  distribution  as  the 
sequence  (em).  then  as  <  ]  0  the  random  variables  (e/j)_1Vr(c)  converge  in  distribution  to  the 
uniform  distribution  on  [0.1).  In  this  sense  when  e  is  small  the  values  em  are  approximately 
equidistributed  over  [O.e/i).  Correspondingly,  the  expression  (|0o|C)-1  —  1  in  (3.2)  equals 
(1  +  o(l))«/i/2  as  f  1  0. 


The  remainder  of  this  section  is  devoted  to  a  proof  of  the  limit  result  (1.26)  for  (Am),  which 
implies  that  if  V’  =  V*(<)  is  a  random  variable  having  the  same  distribution  as  the  sequence 
(Am),  then 


(5.24) 


(efi)_1V,*(f)  — *  1/2  in  probability  as  c  1  0. 


To  prove  (1.26)  it  clearly  suffices  by  (3.3)  to  establish 
(5.25)  E{bm  +  rlV)  -*  1/2  uniformly  in  m  as  e  |  0, 

with  r  =  r(e)  =  and  W  and  ( x )  as  defined  in  Section  3  above.  Because  (6m  +  >*W)  = 
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(fm  +  (rW))  the  proof  of  (5.25)  is  accomplished  by  means  of  the  following  two  lemmas,  in  which 
V  denotes  a  random  variable  uniformly  distributed  on  [0,1). 

Lemma  3.  As  e  J  0, 

(5.26)  (rlV)  — ♦  U  in  distribution. 

Lemma  4.  If  Un  £  [0,1)  are  random  variables  converging  in  distribution  to  V  as  n  — *  oo, 
then  as  n  —  oc 


(5.27)  E(x  +  Vn)  — »  E{x  -4-17)  =  1/2  uniformly  in  x  £  [0, 1). 


Proof  of  Lemma  3.  The  assertion  (5.26)  is  equivalent  to  the  assertion  that  for  j  0  the 
Fourier  coefficient 


(5.28) 


Eexp(2nijr\V)=  ]T  e7rilTnun/u(l)  =  u(e2T,JT)/h(l) 


n= 0 


vanishes  in  the  limit  as  t  |  0.  According  to  (1.17). 


(5.29)  u(e2”'-,r)/ti(  1 )  =  exp 


-^53  k'1  exp(-fcd>(0o)) 


k= 1 


x  exp 


x  exp 


1  k= 1 
oc 

Y,(e2nijkr  ~  l)k-3/2exi>(-k<j>(0o))kl'2(Po{Sk  >  0}  -  1/2) 


L  *=1 


In  examining  the  first  two  factors  on  the  right  in  (5.29)  we  shall  make  use  of  the  well-known 
fact  that,  for  |r|  <  1,  k~lzk  =  -L(l  -  z),  where  L  denotes  the  principal  branch  of  the 
logarithm  function.  Thus 


(5.30)  exp 

as  c  j  0  and 

exp 


-ifr'expt-im))  =  exp  [il(l -€-*<*>>)]  -2-1/2* 


ljre2*'ikTk-'exp(-km)) 


kzsl 


=  exp 


-!/,(!-  e2^>c-4(«o)) 


(5.31) 


For  (5.31 )  we  consider  two  possibilities  according  to  the  value  of  jr(0).  where 

(5.32)  r(0)  :=  limr(e)  =  -h~lb  G  (-1,0]. 

<10 

(a)  If  jr( 0)  $  TL  ,  then  (5.31)  tends  to  exp  [-5Z.U  -  exp(2rtjr(0)))]  G  C  as  c  ]  0. 

(b)  If  jr( 0)  G  TL  ,  then  jr  and  jc/1-1  differ  by  an  integer  and  exp  [-jZ,(l  -  e2’r,'?re-^e°*)]  ~ 
/i1/2(2rji)-,/2exp{  tr//-!)*-1/2  as  <  |  0.  In  either  case  the  product  of  (5.30)  and  (5.31)  is 
0(<»/2)  =  0(!). 

Regarding  the  third  factor  on  the  right  in  (5.29),  by  the  Berrv-Esseen  theorem  (e.g.,  Feller. 
1971,  theorem  XVI. 5.1) 

(5.33)  |(e2ruA'r  _  \  )k-3/2 exp(-ko(e0))kl/\P0{Sk  >  0}  -  1/2)|  <  2Ck-3/2a-3E0\X\3 

where  C  is  a  universal  constant.  In  light  of  the  facts  <r2  —  1  and  £o|-V|3  — *  JE7|  A*  |3,  it  is  apparent 
that  the  third  factor  on  the  right  in  (5.29)  remains  bounded  for  all  small  c.  We  conclude 

(5.34)  i(fj7,J,)/ii(l)  =  0(<1/2)  =  o(l)  as  c  J  0. 

thereby  completing  the  proof  of  Lemma  3.  I 

Proof  of  Lemma  4.  The  difference  RHS  -  LHS  in  (5.27)  equals 

(5.35)  {El'r,  -£(')  +  (E[i  +  TJ  -£lx  +  r„J). 

where  [xj  denotes  the  integer  part  of  x.  i.e.,  the  greatest  integer  no  larger  than  x.  The  first 
of  the  two  differences  in  (5.35)  is  independent  of  x  and  tends  to  zero.  The  second  equals 
P{V  >  1  -  x}  -  P{l'r,  >  1  -  x}  and  tends  to  zero  uniformly  in  x  G  [0, 1 )  by  a  theorem  of  Polya 
(e.g..  Chung.  1974.  exercise  4.3.4).  | 
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20.  ABSTRACT. 


^  Let  XuXti ...  be  »  sequence  of  independent  random  variables  with  common  lattice  dis¬ 
tribution  function  F  having  zero  mean,  and  let  (5«)  be  the  random  walk  of  partial  sums.  The 
strong  law  of  large  numbers  (SLLN)  implies  that  for  any  a  €lRand  c  >  0 

Pm  '■=  P{Sn  >o  +  en  for  some  a  >  m) 

c-f  ■ 

decreases  to  0  as  m  increases  to  oc.  Under  conditions  on  the  moment  generating  function  of  F, 

~  r.' 

we  obtain  the  convergence  rate  by  determining  pm  up  to  asymptotic  equivalence.  When  a  =  0 
and  €  is  a  point  in  the  lattice  for  F,  the  result  is  due  to  Siegmund  [Z.  Wa hrscheinlichkeitstheorie 

verw.  Gebiete  31  ( 1975):107-1 13];  but  this  restriction  on  4  precludes  all  small  values  of  c.  and 

< 

these  values  are  the  most  interesting  vis-a-vis  the  SLLN.  Even  when  o  =  0  our  result  handles 
important  distributions  F  for  which  Siegmund's  result  is  vacuous,  for  example,  the  two-point 
distribution  F  giving  rise  to  simple  symmetric  random  walk  on  the  integers.  ■ 


